Eyewear Device

ABSTRACT

An eyewear device and a method performed at an eyewear device is described, the eyewear device comprising: a frame comprising one or more elements configured, in use, to be in physical contact with at least one body part of a user or wearer of the eyewear device; one or more arms; and one or more microphones, wherein the one or more microphones are configured to detect pressure waves generated at the one or more elements. The method comprises: receiving one or more signals indicative of internal body sounds from the one or more microphones, wherein the one or more microphones are configured to detect pressure waves transmitted by the one or more elements; and processing said signals.

FIELD

The present specification relates to an eyewear device, such as glassesor smart-glasses.

BACKGROUND

Use of microphones in smart-glasses are known. There remains a need forimprovement in sensing sound waves in eyewear devices.

SUMMARY

In a first aspect, this specification provides an eyewear devicecomprising: a frame comprising one or more elements configured, in use,to be in physical contact with at least one body part of a user orwearer of the eyewear device; one or more arms; and one or moremicrophones, wherein the one or more microphones are configured todetect pressure waves generated at the one or more elements. The eyeweardevice may, for example, be glasses, smart-glasses, virtual reality,mixed reality or augmented reality glasses, a headset, head-mounteddisplay, or the like.

In some examples, the eyewear device further comprises at least onechannel, each channel provided between at least one of the one or moremicrophones and at least one of the one or more elements, wherein eachchannel is configured to transfer respective pressure waves from therespective one or more elements to the respective one or moremicrophones.

In some examples, each channel is a substantially air-tight channel.

In some examples, each channel is provided, at least in part, in one ormore of said arms of the eyewear device.

In some examples, the one or more microphones are provided in one ormore of said arms. The eyewear device may comprise one or more hingesenabling said arms to be moved between a folded position and unfoldedposition, wherein the one or more hinges connect channels within theeyewear device. In some examples, said connected channels aresubstantially air-tight when said arms are in the unfolded position.

In some examples, the one or more microphones are provided at saidframe. The eyewear device may comprise one or more hinges enabling saidone or more arms to be moved between a folded position and unfoldedposition, wherein the one or more hinges comprise one or more electriccontacts for connecting the one or more microphones to one or moreelectronic modules of the eyewear device respectively.

In some examples, the one or more elements are conical. In someexamples, the one or more elements comprise soft elastomer material(e.g. silicone, polyurethane, or the like).

In some examples, the at least one body part of the user or wearer ofthe eyewear device comprises the user's or wearer's nasal area.

In some examples, the eyewear device is configured to detect internalbody sounds such as one or more of: one or more eyeball movements, eyewinking, speech, whispered speech, respiration, heartbeat, chewingmovements, sneezes, or coughs.

In a second aspect, this specification provides a method performed at aneyewear device as described with respect to the first aspect,comprising: receiving one or more signals indicative of internal bodysounds from the one or more microphones, wherein the one or moremicrophones are configured to detect pressure waves transmitted by theone or more elements; and processing said signals.

In some examples, processing said signals comprises detecting and/oranalysing movements and/or speech of the user or wearer.

In some examples, processing said signals comprises combining the one ormore signals with one or more speech signals from the one or moremicrophones to detect speech of the user or wearer.

In some examples, processing said signals comprises providing an outputindicative of a user instruction for a user interface.

In a third aspect, this specification provides an apparatus comprisingmeans for performing: receiving one or more signals indicative ofinternal body sounds from the one or more microphones, wherein the oneor more microphones are configured to detect pressure waves transmittedby the one or more elements; and processing said signals.

In some examples, processing said signals comprises detecting and/oranalysing movements and/or speech of the user or wearer.

In some examples, processing said signals comprises combining the one ormore signals with one or more speech signals from the one or moremicrophones to detect speech of the user or wearer.

In some examples, processing said signals comprises providing an outputindicative of a user instruction for a user interface.

The means may comprise: at least one processor; and at least one memoryincluding computer program code, the at least one memory and thecomputer program code configured, with the at least one processor, tocause the performance of the apparatus.

In a fourth aspect, this specification describes an apparatus configuredto perform any method as described with reference to the second aspect.

In a fifth aspect, this specification describes computer-readableinstructions which, when executed by computing apparatus, cause thecomputing apparatus to perform any method as described with reference tothe second aspect.

In a sixth aspect, this specification describes a computer programcomprising instructions for causing a processor of an eyewear device asdescribed with reference to the first aspect, to perform at least thefollowing: receiving one or more signals indicative of internal bodysounds from the one or more microphones, wherein the one or moremicrophones are configured to detect pressure waves transmitted by theone or more elements; and processing said signals.

In some examples, processing said signals comprises detecting and/oranalysing movements and/or speech of the user or wearer. In someexamples, processing said signals comprises combining the one or moresignals with one or more speech signals from the one or more microphonesto detect speech of the user or wearer. In some examples, processingsaid signals comprises providing an output indicative of a userinstruction for a user interface.

In a seventh aspect, this specification describes a computer-readablemedium (such as a non-transitory computer-readable medium) comprisingprogram instructions stored thereon for performing at least thefollowing: receiving one or more signals indicative of internal bodysounds from the one or more microphones, wherein the one or moremicrophones are configured to detect pressure waves transmitted by theone or more elements; and processing said signals.

In some examples, processing said signals comprises detecting and/oranalysing movements and/or speech of the user or wearer. In someexamples, processing said signals comprises combining the one or moresignals with one or more speech signals from the one or more microphonesto detect speech of the user or wearer. In some examples, processingsaid signals comprises providing an output indicative of a userinstruction for a user interface.

In an eighth aspect, this specification describes an apparatuscomprising: at least one processor; and at least one memory includingcomputer program code which, when executed by the at least oneprocessor, causes the apparatus to: receive one or more signalsindicative of internal body sounds from the one or more microphones,wherein the one or more microphones are configured to detect pressurewaves transmitted by the one or more elements; and process said signals.

In some examples, processing said signals comprises detecting and/oranalysing movements and/or speech of the user or wearer. In someexamples, processing said signals comprises combining the one or moresignals with one or more speech signals from the one or more microphonesto detect speech of the user or wearer. In some examples, processingsaid signals comprises providing an output indicative of a userinstruction for a user interface.

In a ninth aspect, this specification describes an apparatus comprising:a first module configured to receive one or more signals indicative ofinternal body sounds from the one or more microphones, wherein the oneor more microphones are configured to detect pressure waves transmittedby the one or more elements; and a second module configured to processsaid signals.

In some examples, processing said signals comprises detecting and/oranalysing movements and/or speech of the user or wearer. In someexamples, processing said signals comprises combining the one or moresignals with one or more speech signals from the one or more microphonesto detect speech of the user or wearer. In some examples, processingsaid signals comprises providing an output indicative of a userinstruction for a user interface.

BRIEF DESCRIPTION OF THE DRAWINGS

Example embodiments will now be described, by way of example only, withreference to the following schematic drawings, in which:

FIG. 1 is a block diagram of a system in accordance with an exampleembodiment;

FIGS. 2 to 6 are illustrations of eyewear devices in accordance withexample embodiments;

FIG. 7 is an illustration of an eyewear device in use in accordance withan example embodiment;

FIG. 8 is an illustration of an element of an eyewear device inaccordance with an example embodiment;

FIGS. 9 and 10 are flowcharts of algorithms in accordance with exampleembodiments;

FIG. 11 is a block diagram of components of a system in accordance withan example embodiment; and

FIG. 12 shows an example of tangible media for storing computer-readablecode which when run by a computer may perform methods according toexample embodiments described above.

DETAILED DESCRIPTION

The scope of protection sought for various embodiments of the inventionis set out by the independent claims. The embodiments and features, ifany, described in the specification that do not fall under the scope ofthe independent claims are to be interpreted as examples useful forunderstanding various embodiments of the invention.

In the description and drawings, like reference numerals refer to likeelements throughout.

FIG. 1 is a block diagram of an eyewear device, indicated generally bythe reference numeral 10, in accordance with an example embodiment. Theeyewear device 10 may, for example, be glasses, smart-glasses, virtualreality glasses, mixed reality or augmented reality glasses, a headset,head-mounted display, or the like. The eyewear device 10 comprises oneor more microphones 11, one or more elements 12, and one or more arms13.

The one or more elements 12 may be comprised within a frame of theeyewear device 10. When the eyewear device 10 is in use (e.g. worn by auser or wearer), the one or more elements 12 are configured to be inphysical contact with at least one body part of the user or wearer ofthe eyewear device 10. For example, the one or more elements 12 may beplaced on a part of the frame that may be in physical contact with anasal area of the user or wearer of the eyewear device 10. In oneexample, for the purposes of this description, a frame of the eyeweardevice 10 comprises part of the eyewear device 10 that is in front ofthe eyes of the user or wearer, and excludes the arms 13 of the eyeweardevice 10.

The one or more microphones 11 are configured to detect pressure wavesgenerated at the one or more elements 12. In one example, the elements12 may comprise pads or membranes that may allow detection ofvibrations, for example, from internal body sounds when said elements 12are in physical contact with at least one body part of the user. In oneexample, the elements 12 comprise pads or membranes made of softelastomer material, such as silicone, polyurethane, or the like. In oneexample, the elements 12 may be similar to miniature stethoscopemembranes.

In an example embodiment, the eyewear device 10 may further comprise atleast one channel 14. Each channel 14 may be provided between at leastone of the one or more microphones 11 and at least one of the one ormore elements 12. Each channel 14 may be configured to transferrespective pressure waves from the respective one or more elements 12 tothe respective one or more microphones 11, thus, for example, enablingthe one or more microphones 11 to detect said pressure waves.

In an example embodiment, the eyewear device 10 may further comprise oneor more hinges 15 enabling the respective one or more arms 13 to bemoved between a folded position and an unfolded position. In oneexample, the one or more hinges 15 may connect channels 14 within theeyewear device 10.

Example configurations of the eyewear device 10 are described in furtherdetail below with reference to FIGS. 2 to 6 .

FIG. 2 is an illustration of an eyewear device, indicated generally bythe reference numeral 20, in accordance with an example embodiment. Theeyewear device 20 comprises arms 23 and a frame 27, which frame 27comprises elements 22 (similar to the elements 12 described above). Theelements 22 may be placed on the frame 27 such that, in use, theelements 22 are in physical contact with at least one body part (e.g.the nasal area) of a user or wearer of the eyewear device 20.

In one example, the elements 22 may generate pressure waves based oninternal body sounds due to being in physical contact with at least onebody part of the user or wearer. For example, the elements 22 may be incontact with the nasal area of the user or wearer, thus generatingpressure waves (e.g. vibrations) derived from internal body sounds, forexample, due to being in contact with bone(s) and/or flesh of the user.Internal body sounds may comprise sounds and/or movements caused by oneor more of eyeball movements, eye winking, speech, whispered speech,respiration, heartbeat, chewing movements, sneezes, and/or coughs. Suchinternal body sounds may cause vibrations to travel through bone(s)and/or flesh of the user towards the one or more elements 22. Forexample, as there may be minimal or no air gap between the elements 22and at least part of the body of the user, the noise within thevibrations may be minimal (e.g. there may be minimal loss in amplitudeof the vibrations).

In one example, the placement of the elements 22 on the frame 27 allowsat least some weight of the eyewear device 20, when in use (worn by auser or wearer) to create pressure on the elements 22, such that theelements 22 are further pressed against the nasal area of the user orwearer, thus improving the physical contact between the elements 22 andthe at least one body part of the user.

The eyewear device 20 may further comprise electronic circuitry 26, forexample, on one or both arms 23. The eyewear device 20 comprises one ormore microphones 21 that may be comprised within the respective arms 23,for example, as part of the electronic circuitry 26. The microphones 21on each side of the eyewear device 20 may detect pressure wavesgenerated by the elements 22 on the respective side, and in turn detectinternal body sounds. For example, the detected internal body sounds maybe turned into electronic signals and processed by one or morecomponents in the electronic circuitry 26.

The eyewear device 20 further comprises hinges 25 enabling said arms 23to be moved between a folded position and an unfolded position.

In an example embodiment, a channel 24 (shown by a dashed line) isprovided between each microphone 21 and element 22, where the channel 24is configured to transfer respective pressure waves from the respectiveone or more elements 22 to the respective one or more microphones 21.For example, a channel 24 a is formed between the respective element 22and the respective hinge 25, and a channel 24 b is formed between therespective microphone 21 and the respective hinge 25. The hinges 25 maytherefore be configured to connect the channels 24 a and 24 b (e.g. whenthe eyewear device is in an unfolded position) in order to create asingle channel 24.

In one example, the each of the channels 24 a and 24 b is an air-tightchannel (e.g. with respect to the outside environment). Therefore, theframe may be sealed in order to allow the channels 24 a and 24 b to besubstantially air-tight. There may be presence of air internally withinthe channels, such that pressure waves (e.g. acoustic pressure waves)are able to travel through the channel.

In one example, the hinge 25 is an air-tight hinge. For example, whenthe eyewear device 20 is in an unfolded position, and the hinge 25connects the channels 24 a and 24 b to form a channel 24, the channel 24is substantially air-tight (e.g. with respect to the outsideenvironment, i.e. a sealed channel). For example, the hinge 25 maycomprise two aligned holes with an air-tight coupling mechanism, suchthat when the arms 23 of the eyewear device 20 are in an unfoldedposition (e.g. when the eyewear device 20 is in use, being worn by auser or wearer), the hinge 25 is substantially air-tight, and connectsair-tight channels 24 a and 24 b to form a single air-tight channel 24.

In an example embodiment, when internal body sounds cause generation ofpressure waves at the elements 22, the pressure waves (e.g. acousticpressure waves) may be transferred from the respective element 22 to therespective microphone 21 via the respective channel 24 and convertedinto signals (e.g. electronic signals) at the microphone 21, therespective channel 24 being air-tight. As the pressure waves aretransferred in an air-tight channel, the signals generated at themicrophone 21 may have a high signal-to-noise ratio (SNR) because theair-tight system allows external noise to be minimized. Furthermore, theinternal body sounds detected by the microphones 21 may be faint (e.g.low amplitude), such that microphones may not be able to detect pressurewaves corresponding to such internal body sounds travelling through airin an external environment without the channels 24.

FIG. 3 is an illustration of an eyewear device, indicated generally bythe reference numeral 30, in accordance with an example embodiment.

Eyewear device 30 comprises arms 33 (similar to arms 23) and a frame 37(similar to frame 27), which frame 37 comprises elements 32 (similar toelements 12 and 22). The elements 32 may be placed on the frame 37 suchthat, in use, the elements 32 are in physical contact with at least onebody part (e.g. the nasal area) of a user or wearer of the eyeweardevice 30.

The eyewear device 30 may further comprise electronic circuitry 36, forexample, on one or both arms 33. The eyewear device 30 is different fromthe eyewear device 20 in that the eyewear device 30 comprises one ormore microphones 31 that may be comprised within the frame 37 (ratherthan at the arms of the eyewear device). For example, the microphones 31may be integrated with the elements 32 at the frame 37.

The microphones 31 on each side may detect pressure waves generated bythe elements 32 on the respective side, and in turn detect internal bodysounds. For example, the detected internal body sounds may be turnedinto electronic signals by the microphones 31, which electronic signalsmay be transmitted to and processed by one or more components in theelectronic circuitry 36.

The eyewear device 30 further comprises hinges 35 enabling said arms 33to be moved between a folded position and an unfolded position.

In an example embodiment, a channel 34 (shown by a dashed line) isprovided between each microphone 31 and electronic circuitry 36, wherethe channel 34 is configured to transfer respective electronic signals(e.g. generated based on internal body sounds causing pressure waves tobe generated at the elements 32 and detected by the microphones 31) fromthe microphone 31 to the electronic circuitry 36.

In one example, the channel(s) 34 comprise electric lines (e.g. copperwiring) for delivering electric signals to the electronic circuitry 36.

In one example, the hinges 35 comprise one or more electric contacts forconnecting the microphone(s) 31 to one or more electronic modules ofelectronic circuitry 36.

In one example, the electric contacts in the hinges 35 may allow themicrophones 31 to be connected to the electronic circuitry 36 when theeyewear device 30 is in an unfolded position (e.g. in use, being worn bya user or wearer), and may disconnect the microphones 31 from theelectronic circuitry 36 when the eyewear device 30 is in a foldedposition (e.g. not in use).

FIG. 4 is an illustration of an eyewear device, indicated generally bythe reference numeral 40, in accordance with an example embodiment.

Eyewear device 40 is similar to eyewear device 20, comprising arms 23and a frame 27, which frame 27 comprises elements 22. The eyewear device40 comprises electronic circuitry 46 and microphones 21, for example, aspart of the electronic circuitry 46. The eyewear device 40 furthercomprises a hinge 25 enabling said arms 23 to be moved between a foldedposition and unfolded position.

The eyewear device 40 is different from the eyewear device 20 in thatthe eyewear device 40 comprises electronic circuitry 46 at the hinge 25,the frame 27, or in a position that is relatively (in comparison withelectronic circuitry 26) nearer to the frame 27. A channel 44 (shown bya dashed line) may be provided between each microphone 21 and respectiveelement 22. The positioning of the microphone at or near the hinge 25,or frame 27, allows the channel 44 to be provided in the frame 27 (e.g.the channel 44 may not extend to the arms 23).

The channel 44 is configured to transfer respective pressure waves fromthe respective one or more elements 22 to the respective one or moremicrophones 21. The channel 44 may be an air-tight channel (e.g. withrespect to the outside environment). Therefore, the frame may be sealedin order to allow the channels 44 to be substantially air-tight. Theremay be presence of air internally within the channel 44, such thatpressure waves (e.g. acoustic pressure waves) are able to travel throughthe channel 44.

In one example, the hinge 25 may comprise electrical connectionsconnecting to the electronic circuitry 46.

Alternatively, the hinge 25 may be an air-tight hinge. For example, whenthe eyewear device 20 is in an unfolded position, the hinge 25 may formpart of the channel 44, thus allowing pressure waves to travel fromelement 22 to microphone 21. For example, the hinge 25 may comprise twoaligned holes with an air-tight coupling mechanism, such that when thearms 23 of the eyewear device 40 are in an unfolded position (e.g. whenthe eyewear device 20 is in use, being worn by a user or wearer), thehinge 25 is air-tight.

FIG. 5 is an illustration of an eyewear device, indicated generally bythe reference numeral 50, in accordance with an example embodiment.

Eyewear device 50 is similar to eyewear device 30, comprising arms 33and a frame 37, which frame 37 comprises elements 32. The eyewear device30 comprises one or more microphones 31 that may be comprised within theframe 37. For example, the microphones 31 may be integrated with theelements 32 at the frame 37.

The eyewear device 50 may further comprise electronic circuitry 56, atthe hinge 35, the frame 37, or in a position that is relatively (incomparison with electronic circuitry 36) nearer to the frame 37.

The microphones 31 on each side may detect pressure waves generated bythe elements 32 on the respective side, and in turn detect internal bodysounds. For example, the detected internal body sounds may be turnedinto electronic signals by the microphones 31, which electronic signalsmay be transmitted to and processed by one or more components in theelectronic circuitry 56.

The eyewear device 50 further comprises hinges 35 enabling said arms 33to be moved between a folded position and an unfolded position.

In an example embodiment, a channel 54 (shown by a dashed line) isprovided between each microphone 21 and electronic circuitry 56, wherethe channel 54 is configured to transfer respective electronic signals(e.g. generated based on internal body sounds causing pressure waves tobe generated at the elements 32 and detected by the microphones 31) fromthe microphone 31 to the electronic circuitry 56.

In one example, the channel(s) 54 comprise electric lines (e.g. copperwiring) for delivering electric signals to the electronic circuitry 56.

In one example, the hinges 35 comprise one or more electric contacts forconnecting the microphone(s) 31 to one or more electronic modules ofelectronic circuitry 56.

In one example, the electric contacts in the hinges 35 may allow themicrophones 31 to be connected to the electronic circuitry 56 when theeyewear device 50 is in an unfolded position (e.g. in use, being worn bya user or wearer), and may disconnect the microphones 31 from theelectronic circuitry 56 when the eyewear device 30 is in a foldedposition (e.g. not in use).

FIG. 6 is an illustration of an eyewear device, indicated generally bythe reference numeral 60, in accordance with an example embodiment. Theeyewear device 60 is shown in a folded position, comprising arms 63(e.g. similar to arms 13, 23, 33), hinges 65 (e.g. similar to hinges 15,25, 35), elements 62 (e.g. similar to elements 12, 22, 32), and frame 67(similar to frames 27, 37). For example, the eyewear device 60 may be ina folded position when the arms 63 are folded (e.g. substantiallyparallel) with respect to the frame 67. In contrast, for example, theeyewear devices 20, 30, 40, and 50, are shown in an unfolded position,where the arms 23 or 33 are unfolded (e.g. substantially perpendicular)with respect to the frame 27 or 37.

FIG. 7 is an illustration of an eyewear device in use, indicatedgenerally by the reference numeral 70, in accordance with an exampleembodiment. The illustration 70 shows an eyewear device 71 (similar toone or more of eyewear devices 10, 20, 30, 40, 50, and 60) in use, forexample, by being worn by a user or wearer 72. The eyewear device 71comprises elements 73 (similar to elements 12, 22, 32, 62) and hinges 74(similar to hinges 15, 25, 35, 65).

As shown in the illustration 70, when the eyewear device 71 is in use,the elements 73 are configured to be in physical contact with at leastone body part of a user or wearer 72 of the eyewear device 71. The atleast one body part of the user or wearer 72 comprises the nasal area ofthe user or wearer. For example, it can be seen in illustration 70 thatthe eyewear device 71 rests on the nose of the user or wearer 72, suchthat the elements 73 are in physical contact with the nasal area or theuser or wearer 72. When the eyewear device 71 is in use, the hinges 74are in an unfolded position (e.g. substantially perpendicular withrespect to a frame of the eyewear device 71).

FIG. 8 is an illustration of an element, indicated generally by thereference numeral 80 of an eyewear device in accordance with an exampleembodiment. The element 80 may be conical in shape. One or more of theelements 12, 22, 32, 62, and 73 described above may be similar toelement 80, thus having a conical shape.

The element 80 may comprise an elastomer material, such as one or moreof soft silicone, polyurethane, or the like.

In one example, the element 80 comprises a first opening 81 and a secondopening 82. The first opening 81 may be a relatively large opening (e.g.compared to the second opening 82), for example at a base of the conicalshape, and may be oriented on an eyewear device to be in physicalcontact with at least one body part (e.g. nasal area) of a user orwearer when the eyewear device is in use. The second opening 82 may be arelatively small opening (e.g. compared to the first opening 81), forexample at a tip of the conical shape, and may be oriented on an eyeweardevice to be in physical contact with the frame of the eyewear device.For example, the second opening 82 may be oriented on the frame of theeyewear device to be placed towards a microphone (e.g. microphone 11,21, 31) or towards a channel (e.g. channel 24, 44) that allows pressurewaves from the element 80 to travel to a microphone.

For example, the element 80 may have functionality of being in contactwith the user skin at the first opening 81, such that the element 80 isable to generate pressure waves based on internal body sounds (e.g.eyeball friction sounds, speech sounds from the larynx of the user orwearer, or any other physiological internal sounds coming from the userbody).

FIG. 9 is a flowchart of an algorithm, indicated generally by thereference numeral go, in accordance with an example embodiment. In oneexample, the algorithm 90 may be performed at an electronic module (e.g.processor), for example, provided in or connected to electroniccircuitry (26, 36, 46, 56) of an eyewear device (10, 20, 30, 40, 50, 60,71).

The algorithm 90 starts with operation 92, where one or more signalsindicative of internal body sounds are received from one or moremicrophones, such as microphones 11, 21, and/or 31. The one or moremicrophones are configured to detect pressure waves transmitted by theone or more elements (12, 22, 32, 62, 73) and the microphones may inturn generate electronic signals based on the detected pressure waves.The generated electronic signals are then sent to the electronic module,such as a processor (e.g. comprised within or connected to electroniccircuitry within the eyewear device).

Next, at operation 94, the received signals are processed. Processing ofthe signals are described in further detail below with reference to FIG.10 .

FIG. 10 is a flowchart of an algorithm, indicated generally by thereference numeral 100, in accordance with an example embodiment. In oneexample, the algorithm 100 may be performed at an electronic module(e.g. processor), for example, provided in or connected to electroniccircuitry (26, 36, 46, 56) of an eyewear device (10, 20, 30, 40, 50, 60,71).

The algorithm 100 starts with operation 92 (as discussed above withreference to FIG. 9 ), where one or more signals indicative of internalbody sounds are received from one or more microphones, such asmicrophones 11, 21, and/or 31.

Next, algorithm 100 may proceed to one or more of operations 102, 104,and 106, which are optional operations. The operations 102, 104, and 106may be example implementations of the step 94 for processing thereceived signals.

At operation 102, one or more of the received signals may be combinedwith one or more speech signals from said microphones. For example, themicrophones of an eyewear device may be configured to detect pressurewaves, indicative of internal body sounds, generated from the elements(12, 22, 32, 62, 73, e.g. pads or membranes) provided in the frame ofthe eyewear device. The same or different microphones of the eyeweardevice may further be configured to detect speech or other soundsreceived through the external environment (e.g. speech signals from theuser or wearer received through air (not through the frame of theeyewear device)). Therefore, microphones may generate signals (receivedat operation 92) relating to internal body sounds, and may furthergenerate speech signals. Said signals and speech signals can becombined, for example, in order to detect speech of the user or wearer.For example, by combining signals indicative of internal body sounds andspeech signals, signal noise ratio (SNR) of the detected speech may beimproved, and therefore speech detection is improved.

At operation 104, the received signals of operation 92 may be processedby detecting and/or analysing movements and/or speech of the user orwearer. For example, the received signals are indicative of internalbody sounds, such as eyeball movements, eye winking, speech, whisperedspeech, respiration, heartbeat, chewing movements, sneezes, and orcoughs. These internal body sounds may be detected by analysing thereceived signals, for example, based on a model, or machine learningalgorithms.

At operation 100, the received signals may be processed by providing anoutput indicative of a user instruction. For example, certain movementsor internal body sounds or gestures can be predefined for indicating auser instruction for control of a user interface. The user interface maybe of a user device, such as the eyewear device itself (10, 20, 30, 40,50, 60, 71), a mobile phone or any other user device, which may beconnected and/or paired with the eyewear device.

For example, the internal body sounds detected from the signals maycomprise an eye wink. As the eyewear device may comprise microphones onboth sides, it can be detected whether the signals are indicative of aleft eye wink or a right eye wink (based on whether pressure waves weregenerated at a left element (22, 32, 62, 73) or a right element (22, 32,62, 73)). For example, a left eyewink may be a predefined userinteraction for moving content of a screen (e.g. on a user device)towards the left direction, and a right eye wink may be a predefineduser interaction for moving content of a screen towards the rightdirection. Therefore, when the signals indicate that the user or wearerwinked their left eye, an output is provided at operation 106 to beindicative of the user instruction to move the content of a screentowards the left direction. Alternatively, when the signals indicatethat the user or wearer winked their right eye, an output is provided atoperation 106 to be indicative of the user instruction to move thecontent of a screen towards the right direction. In one example,simultaneous winking or blinking of both the left and right eye may be apredefined user interaction for selecting a content of a screen orexecuting a function on the user device. When the signals indicate thatthe user or wearer winked or blinked both their left and right eyes, anoutput is provided at operation 106 to be indicative of the userinstruction to select a content or execute a function on the userdevice.

In one example, one or more of eye winking, eye blinking, eye rolling,speech, or the like may be used in combination as a predefined userinteraction for executing a predefined user instruction. As such, if anysuch a combination is detected from the signals, an output indicative ofthe said predefined user instruction may be generated.

It will be appreciated that the above gestures or interactions areprovided as examples only, and there may be many other types of patterns(e.g. speech, sound, facial, or other patterns) or combinations ofpatterns that may be used for providing an output indicative of a userinstruction.

It should be appreciated that the eyewear device may be of any othershape or form, and that the illustrations of FIGS. 2 to 7 , are examplesonly.

For completeness, FIG. 11 is a schematic diagram of components of one ormore of the example embodiments described previously, which hereafterare referred to generically as processing systems 300. A processingsystem 300 may have a processor 302, a memory 304 closely coupled to theprocessor and comprised of a RAM 314 and ROM 312, and, optionally, userinput 310 and a display 318. The processing system 300 may comprise oneor more network/apparatus interfaces 308 for connection to anetwork/apparatus, e.g. a modem which may be wired or wireless.Interface 308 may also operate as a connection to other apparatus suchas device/apparatus which is not network side apparatus. Thus, directconnection between devices/apparatus without network participation ispossible.

The processor 302 is connected to each of the other components in orderto control operation thereof.

The memory 304 may comprise a non-volatile memory, such as a hard diskdrive (HDD) or a solid-state drive (SSD). The ROM 312 of the memory 304stores, amongst other things, an operating system 315 and may storesoftware applications 316. The RAM 314 of the memory 304 is used by theprocessor 302 for the temporary storage of data. The operating system315 may contain computer program code which, when executed by theprocessor implements aspects of the algorithms 90 and 100 describedabove. Note that in the case of small device/apparatus the memory can bemost suitable for small size usage i.e. not always hard disk drive (HDD)or solid-state drive (SSD) is used.

The processor 302 may take any suitable form. For instance, it may be amicrocontroller, a plurality of microcontrollers, a processor, or aplurality of processors.

The processing system 300 may be a standalone computer, a server, aconsole, or a network thereof. The processing system 300 and neededstructural parts may be all inside device/apparatus such as IoTdevice/apparatus i.e. embedded to very small size In some exampleembodiments, the processing system 300 may also be associated withexternal software applications. These may be applications stored on aremote server device/apparatus and may run partly or exclusively on theremote server device/apparatus. These applications may be termedcloud-hosted applications. The processing system 300 may be incommunication with the remote server device/apparatus in order toutilize the software application stored there.

FIG. 12 shows tangible media, specifically a removable memory unit 365,storing computer-readable code which when run by a computer may performmethods according to example embodiments described above. The removablememory unit 365 may be a memory stick, e.g. a USB memory stick, havinginternal memory 366 for storing the computer-readable code. The internalmemory 366 may be accessed by a computer system via a connector 367.Other forms of tangible storage media may be used. Tangible media can beany device/apparatus capable of storing data/information whichdata/information can be exchanged between devices/apparatus/network.

Embodiments of the present invention may be implemented in software,hardware, application logic or a combination of software, hardware andapplication logic. The software, application logic and/or hardware mayreside on memory, or any computer media. In an example embodiment, theapplication logic, software or an instruction set is maintained on anyone of various conventional computer-readable media. In the context ofthis document, a “memory” or “computer-readable medium” may be anynon-transitory media or means that can contain, store, communicate,propagate or transport the instructions for use by or in connection withan instruction execution system, apparatus, or device, such as acomputer.

Reference to, where relevant, “computer-readable storage medium”,“computer program product”, “tangibly embodied computer program” etc.,or a “processor” or “processing circuitry” etc. should be understood toencompass not only computers having differing architectures such assingle/multi-processor architectures and sequencers/parallelarchitectures, but also specialised circuits such as field programmablegate arrays FPGA, application specify circuits ASIC, signal processingdevices/apparatus and other devices/apparatus. References to computerprogram, instructions, code etc. should be understood to expresssoftware for a programmable processor firmware such as the programmablecontent of a hardware device/apparatus as instructions for a processoror configured or configuration settings for a fixed functiondevice/apparatus, gate array, programmable logic device/apparatus, etc.

As used in this application, the term “circuitry” refers to all of thefollowing: (a) hardware-only circuit implementations (such asimplementations in only analogue and/or digital circuitry) and (b) tocombinations of circuits and software (and/or firmware), such as (asapplicable): (i) to a combination of processor(s) or (ii) to portions ofprocessor(s)/software (including digital signal processor(s)), software,and memory(ies) that work together to cause an apparatus, such as aserver, to perform various functions) and (c) to circuits, such as amicroprocessor(s) or a portion of a microprocessor(s), that requiresoftware or firmware for operation, even if the software or firmware isnot physically present.

If desired, the different functions discussed herein may be performed ina different order and/or concurrently with each other. Furthermore, ifdesired, one or more of the above-described functions may be optional ormay be combined. Similarly, it will also be appreciated that the flowcharts of FIGS. 9 and 10 are examples only and that various operationsdepicted therein may be omitted, reordered and/or combined.

It will be appreciated that the above described example embodiments arepurely illustrative and are not limiting on the scope of the invention.Other variations and modifications will be apparent to persons skilledin the art upon reading the present specification.

Moreover, the disclosure of the present application should be understoodto include any novel features or any novel combination of featureseither explicitly or implicitly disclosed herein or any generalizationthereof and during the prosecution of the present wo application or ofany application derived therefrom, new claims may be formulated to coverany such features and/or combination of such features.

1-18. (canceled)
 19. An eyewear device comprising: a frame comprisingone or more elements configured, in use, to be in physical contact withat least one body part of a user or wearer of the eyewear device; one ormore arms; and one or more microphones, wherein the one or moremicrophones are configured to detect pressure waves generated at the oneor more elements.
 20. An eyewear device as claimed in claim 19, furthercomprising at least one channel, wherein a respective one of the atleast one channel is provided between a respective one of the one ormore microphones and a respective one of the one or more elements,wherein the respective channel is configured to transfer respectivepressure waves from the respective element to the respective microphone.21. An eyewear device as claimed in claim 20, wherein the at least onechannel is an air-tight channel.
 22. An eyewear device as claimed inclaim 20, wherein the at least one channel is provided, at least inpart, in one or more of said arms of the eyewear device.
 23. An eyeweardevice as claimed in claim 19, wherein the one or more microphones areprovided in at least one of said arms.
 24. An eyewear device as claimedin claim 23, wherein the eyewear device comprises one or more hingesconfigured so that the one or more arms are moveable between a foldedposition and an unfolded position, wherein the one or more hingesconnect channels within the eyewear device.
 25. An eyewear device asclaimed in claim 24, wherein said connected channels are air-tight whenthe one or more arms are in the unfolded position.
 26. An eyewear deviceas claimed in claim 19, wherein the one or more microphones are providedat or within the frame.
 27. An eyewear device as claimed in claim 26,wherein the eyewear device comprises one or more hinges configured sothat the one or more arms are moveable between a folded position and anunfolded position, wherein the one or more hinges comprise one or moreelectric contacts configured to connect the one or more microphones toone or more electronic modules of the eyewear device respectively. 28.An eyewear device as claimed in claim 19, wherein the one or moreelements are conical.
 29. An eyewear device as claimed in claim 19,wherein the one or more elements comprise an elastomer material.
 30. Aneyewear device as claimed claim 19, wherein the at least one body partof the user or wearer of the eyewear device comprises the user's orwearer's nasal area.
 31. An eyewear device as claimed in claim 19,wherein the eyewear device is configured to detect internal body soundscomprising at least one of: one or more eyeball movements, eye winking,speech, whispered speech, respiration, heartbeat, chewing movements,sneezes, or coughs.
 32. An eyewear device as claimed in claim 19 furthercomprising: at least one processor; and at least one memory storinginstructions that, when executed by the at least one processor, causethe eyewear device to: receive one or more signals indicative ofinternal body sounds from the one or more microphones, wherein the oneor more microphones are configured to detect pressure waves transmittedby the one or more elements; and process said signals.
 33. An eyeweardevice as claimed in claim 32, wherein processing said signals comprisescombining the one or more signals with one or more speech signals fromthe one or more microphones to detect speech of the user or wearer. 34.A method comprising: receiving, at an eyewear device as claimed in claim19, one or more signals indicative of internal body sounds from the oneor more microphones, wherein the one or more microphones are configuredto detect pressure waves transmitted by the one or more elements; andprocessing, at said eyewear device, said signals.
 35. A method asclaimed in claim 34, wherein processing said signals comprises detectingor analyzing movements or speech of the user or wearer.
 36. A method asclaimed in claim 34, wherein processing said signals comprises combiningthe one or more signals with one or more speech signals from the one ormore microphones to detect speech of the user or wearer.
 37. A method asclaimed in claim 34, wherein processing said signals comprises providingan output indicative of a user instruction for a user interface.
 38. Anon-transitory computer readable medium comprising program instructionsstored thereon for causing a processor of an eyewear device as claimedin claim 1 to perform at least the following: receiving one or moresignals indicative of internal body sounds from the one or moremicrophones, wherein the one or more microphones are configured todetect pressure waves transmitted by the one or more elements; andprocessing said signals.